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[57] ABSTRACT 

An adaptive abort criterion in iterative decoding of 
transmitted, multi-dimensionally encoded information 
employs the relative entropy, approximations of the relative 
entropy or quantities similar thereto as criterion for the 
change in the weighted decisions of successive iteration 
sub-steps. When an iteration sub-step does not produce a 
change of the relative entropy lying above a predetermined 
threshold, then the iterative decoding is aborted. 

15 Claims, 1 Drawing Sheet 
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METHOD AND ARRANGEMENT FOR 
DETERMINING AN ADAPTIVE ABORT 
CRITERION IN ITERATIVE DECODING OF 
MULTI-DIMENSIONALLY CODED 
INFORMATION 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates generally to a method and 
apparatus for aborting an iterative decoding process of 
encoded information after a number of iterations as deter- 
mined by the present method. 

2. Description of the Related Art 

In data transmission, errors that are to be recognized and 
corrected at the data reception side occur in the transmission 
of information from a transmitter to a receiver on disturbed 
or noisy transmission channels. To that end. further, redun- 
dant check characters are transmitted in the channel coding 
in addition to the characters which represent the informa- 
tion. 

In data channel coding, the encoder means at the trans- 
mitter side derives check characters from the characters 
representing the information on the basis of a corresponding 
coding scheme. The use of these check characters makes it 
possible at the receiver side to detect altered information 
characters and to potentially correct them. Variously con- 
figured encoding methods are available for channel coding. 
Included in the code group which can be employed are the 
parallel, chained, systematic recursive codes — "turbo 
codes**— disclosed by C. Berrou, in the publication "Near 
Shannon Limit Error-correcting and Decoding: Turbo- codes 
(1)**. Proc. ICC '93, May 1993, and by C. Berrou and A. 
Glavieux. in the Publication "Turbo-codes: General Prin- 
ciples and Applications* 1 , as well as by R. de Gaudenzi and 
M. Luise (Ed.), in Audio and Video Digital Radio Broad- 
casting Systems and Techniques. Proc. of the 6th Hrrenia 
Int. Workshop on Digital Communications, pp.215-226. 
1993. 

Multi-dimensional codes are iteratively decoded at the 
information reception side. In the case of two systematic 
recursive codes. C. Berrou discloses an iterative decoding 
method in European Patent Application EP 92 460 011.7 
without, however, discussing adaptive abort criteria. Adap- 
tive abort criterion differs from iterative decoding which 
utilizes a predetermined, fixed number of iterations, in that 
adaptive abort criteria allows the number of iterations to be 
flexibly adapted to the progress of the decoding process. 
Statistical investigations show that the decoded check char- 
acters can often already be identified with high dependabil- 
ity after a few iterations. Further iterations contribute very 
little to the performance capability of the coding method. 

M. Moher, in the publication "Decoding via Cross- 
Entropy Minimization**, Proceedings of GLOBECOM '93, 
IEEE Global Telecommunications Conference, Vol.2, 
Houston, Tex., USA. 19 Nov.-2 Dec. 1993, pp.809-813, 
discloses a decoding method for decoding product codes that 
is based on an estimate of entropy, or measure of the loss of 
information in a transmitted message. The received channel 
information is compared to the code words which are 
determined from the parity equations (the parity bits and 
useful bits). The mare similar the decoding result (the 
specific code words) is to the channel information, the better 
the decoding — the relative entropy is thereby minimal. The 
relative entropy thereby serves as optimization criterion for 
the decoding. 
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P. Robertson, in the publication "Illuminating the Struc- 
ture of Code and Decoder for Parallel Concatenated Recur- 
sive Systematic (Turbo) Codes** submitted at GLOBECOM 
'94. discloses an adaptive abort criterion based on a com- 

5 parison of the noise variance of the channel transmitting the 
information to a channel identified by a predetermined 
signal-to-noise ratio and, thus, an error rate. When the noise 
variance that Is identified after an iteration step yields a 
value smaller than the predetermined value corresponding to 

10 a signal-to-noise ratio, then the iterative decoding process is 
aborted. An abort criterion is thus presented that is based on 
an estimate of the quality of the decoding and is merely 
founded on the empirical determination that the noise vari- 
ance up to the iteration step which enables , the complete 

15 error elimination is very high given highly error-laden 
character sequences. Further, the calculating outlay for 
determining mis abort criterion is extremely high. 

SUMMARY OF THE INVENTION 

20 

An object of the present invention is to provide a method 
and an arrangement for determining an adaptive abort cri- 
terion given iterative decoding of multi-dimensionally 
coded information that avoids the afore-mentioned disad- 
23 vantages. 

This and other objects and advantages are achieved 
according to the invention by a method for determining an 
adaptive abort criterion in the iterative decoding of multi- 
dimensionally coded information, whereby, following an 

30 iteration sub-step, a first weighted decision, the soft output, 
about the information to be decoded is compared to a second 
weighted decision that is acquired from a combination of 
sub-results of preceding iteration sub-steps which differs 
from the first weighted decision, and the iterative decoding 

35 is aborted dependent on the comparison result 

An arrangement for implementing the inventive method is 
provided by a decoder module providing determination of an 
adaptive abort criterion in the iterative decoding of multi- 
dimensionally coded information, comprising means for 
40 determining and storing weighted decisions after an iteration 
sub-step, means for comparing the weighted decisions, and 
means for initiating an abort of the iterative decoding 
dependent on the comparison result 

45 The special inventive aspect lies in the utilization of the 
information (the extrinsic information) that is additionally 
acquired during the process of the iterative decoding for the 
determination of the abort step of the decoding method. 
After each decoding step of one of the component codes of 
the multi-dimensional code, the weighted decision (which is 
the soft output) can be formed over each of the information 
characters to be decoded (particularly information bits given 
digital characters) as a sum of the extrinsic information from 
the respectively last decoding step of each and every com- 

55 ponent code of the channel information as well as of the 
potentially existing a priori information about the appertain- 
ing information bit. The determination of the approximate 
relative entropy from the weighted decisions of two sub- 
iterations that forms the basis of the proposed abort criterion 
can thus be initiated both after a sub-iteration step as well as 
after a complete iteration. 

The method for determinating an adaptive abort criterion 
shall be explained in brief below on the basis of derivations 
of information theory. It is based essentially on an approxi- 
65 mation of the relative entropy (cross entropy, relative 
entropy) D(P|IQ) of two distributions P and Q that is a 
criterion for the difference of the distributions P and Q. 
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Let L/^COJ be the soft output over the decoded infor- approximations of the cross entropy instead of 

mation bit 0* after the i th sub-iteration of the decoding of an D^ 0 ))^ 0 ). the cross entropy itself or other quantities whose 

n-dimensional * turbo" code that is composed in the follow- properties are similar to the cross entropy. Particularly 

iog way: included in the latter group are the quantities that mainly 

5 evaluate the difference in the results of the decoding of two 

i$r \=l, i^r \ W 01 morc d iff crent sub-iterations by difference formation of 

>(<ft} * n ^ j=\ T the soft output values or by difference formation of parts of 

the soft output values. 

L y k thereby references the channel information. my The determination of a threshold to which the relative 

references the a prion information and L„; '(QJ references cmropy ^ compared represents a characteristic value that is 

the extrinsic information from me coding of the j" cornpo- selectable according to the type of service to which the 

nent code that is current at the point in time L Let L F ( '(uj transmitted information belongs. When the information is 

characterize the binary distribution P**'). The distribution transmitted within pre<tetermined frames, the threshold can 

Q/ 0 is then characterized by the L-value L^QJ that be separately determined for each frame as an example of 

differs from L/°(u*) in that at least one summand derives the flexibility of the present method, 

from the sum over the n extrinsic information from a 13 It is within the scope of the present method that the abort 

preceding sub-iteration ^(E;<i). criterion mat has been determined can be combined with 

Under the conditions mat sign(L P ( °(0 Jt ))=sign(L {2 < '\u Jk )), further, additional abort criteria. For example, this additional 

IL / » C0 (a Jt )l»l, 0L c <o (flJI»l, tL/^u^lL^Ujk)! and IL/ 0 abort criterion can be a fixed number of iterations that marks 

(0 Jt >-L < , 2 (0 Jt )l«l then the equation a maximum decoding delay which can be tolerated. 

20 Exemplary embodiments of the present method provide 

- ^ _ -dgin* tti - ... 2 (2 \ that the weighted decisions on which the comparison is 

Dtf?nflP)«e \LP("*)-ty\"tf based are formed from the components of the code corre- 

. - . sponding to the dimension of the code, being formed after 

a^ximately corresponds to the cross entropy of the <hs- ^^edon of a complete iteration step. An additional 

tnbutions P k and . 23 improvement provides that the weighted decisions on which 

When the statistical independence of the individual deci- me comparison is based are employed for calculating a 

sions is also assumed, then the equation relative entropy; the relative entropy is compared to a 

threshold; and the iterative decoding is aborted when the 

b(P® b Qfh - r lxpV h (A 1 *) ^ relative entropy is smaller than the threshold. The decoding 

(k) 30 is aborted when the relative entropy is smaller than the 

. . _ r^mu^ * *t -a u threshold or the number of iterations already completed 

ar^oximates toe cross entropy D(P||Q) of the i* sub- con ^ to a predetermined number. The threshold is 

lotion that since P^^s dependent on the L-values of the ^^ependent on the desired transmission quality and 

toeL-valueso^ £ * decoded is transrnitxedwithmapluratityof 

lvalues of at least one r*evious sur>iteration ii a 35 ^ ^ determined for each 

criterion for the change in the decisions of two sub-iterations f rame 

* *?? . „ * *u •* a jr a Instead of the relative entropy, approximations of the 

Since the abort step °f the iterative decoding after a TtMvt ^ lo ^ ^ othcr tities 

sub-iteration i should ideally ensue exactiy when , toher whose ^ $ m ^^io the relative en tropy or which 

^Uerauons also effect no change in the result of the 40 ^ ^ mmm formation ofthe wc i^ted deci- 

decoding, the abort cntcnon can be formulated as follows sion ^ ^ J fbmof „ employed for the weighted deci- 

with the assistance of D(P W ||Q W ). The iterative decoding sions mst ead of the relative entropy, 

can be aborted after the sub-iteration i when Tables with non-linearly quantized input and output val- 

_ 45 ues may be utilized for the determination of the relative 

m UwT r^- entropy or approximations thereof 

The quality as well as the complexity of the decoding can be Additional abort criteria may be involved in the decision 

influenced by the selection of the threshold S. about me abort of iterative decoding. 

The special advantage of mis procedure is comprised that ^ mventioD provides a decoding module for per- 
the additionally acquired information (the extrinsic 50 fanning the inventive method. The decoder module, pro- 
information) are already generated by the known method, Vldin 8 determination of an adaptive abort criterion in the 
Le., additional calculating events are eliminated. iterative decoding of multi-dimensionally coded 

According to an advantageous development of the inven- information, includes means for determining and storing 

live method, the comparison ofthe weighted decisions over weighted decisions after an iteration sub-step, means for 

the information bits is formed after completion of a com- 55 comparing toe weighted decisions, and means for initiating 

plete iteration step upon involvement of the extrinsic infor- 3°°* rf iterative decoding dependent on toe com- 

mation acquired from the decoding of all component codes parison result The means for determining and storing toe 

of the multi-dimensional code. As a result thereof, the weighted decisions are fashioned such that 

contribution of an iteration step is completely evaluated and me first weighted decision is acquired from the current 

integrated into the abort criterion. 60 iteration step; 

The calculation of the approximation of toe relative the second weighted decision is acquired from a combi- 
entropy can be undertaken by processing the extrinsic nation of sub-results of preceding iteration sub- steps 
information, and the result can be compared to a threshold. differing from the first weighted decision; and the 
When the relative entropy is lower than the threshold, toe means for comparing the weighted decisions are fash- 
iterative decoding can be aborted. The proposed adaptive 65 ioned such that 

abort criterion encompasses all the methods that, instead of the relative entropy is determined from toe weighted 

employing equation (4) in toe abort criterion, employ other decisions, the relative entropy is compared to a 
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threshold, and the iterative decoding is aborted by the example, the switchover US switches two serially existing 

means for initiating an abort of the iterative decoding sequences of check characters Y p onto the two decoders 

when the relative entropy is smaller than the threshold. DEC1 and DEC2 at the right time and potentially inserts 

Means for setting the threshold are provided, so that the neutral characters. Parallel lines can also certainly be 

threshold can be separately set for each frame for informa- 5 selected, foregoing the switchover US for the check char- 

tion transmitted in frames. The means for initiating the abort acters Y p , 

of the iterative decoding dependent on the comparison result The second decoder DEC2 is connected, first to an input 

likewise effect the abort of the iterative decoding after a of a first de-interleaver DEI and, second, to an input of a 

maximum number of iterations determined by the setting second de-interleaver DE2. The first de-interleaver DEI 

means. 10 makes a signal which is the soft output of the iteration, 

available an the output. The output of the second 

BRIEF DESCRIPTION OF THE DRAWINGS de-interleaver DE2 processes a fourth intermediate informa- 

The present invention shall be described in greater detail ^ x4 representing the extrinsic information acquired by 

with reference to an exemplary embodiment which is shown , , ™' iteration ^ s fourth intermediate informa- 

in the drawings. Uon x4, after F 10 ^ 58111 ^ being supplied to an input of the 

r a a i first register RL 

FIG. 1 is a block circuit diagram of a decoder module _ * „ . , , 

according to the present method; and ™ c f soft Vi * * e ™tput of the first 

f\ .... ... , . . . . . de-interleaver DEI is applied both to an input of a second 

FIG. 2 is a block circuit dia^am of the device within the a R2 as well as to an input of a device INT. A second 

decoder that effects an abort of the iterative decoding. 20 in ^ t of me device j^T is connected to the output of the 

DETAILED DESCRIPTION OF THE second register R2. A signal a representing the abort decision 

PREFERRED EMBODIMENTS is P* 0 * 1 ^ at an output of the device INT that determines 

the abort, or halt of the iterative decoding process. 

The decoder module in FIG. 1 effects an iteration step for The shift registers SRI and SR2 delay the characters Xp 

the purpose of iterative decoding of recdved information. In 23 representing the information and the check characters Y p 

the selected example, a feedback of an extrinsic information un tL| the decisions made by the iteration step are present at 

Zp generated in the decoding ensues (the decoding process me outputs of the decoder module. For example, the decoder 

uses a feedback method). However, it is also possible to module processes binary characters, whereby the characters 

connect a plurality of such decoder modules to one another y y p and Zp are available as bit sequences of n bits, 

(which results in decoding by a pipeline method). 30 DEC l corresponds with the first encoder 

The module has three inputs for the characters X,, reprc- c f the coder means. The decoding result of the first decoder 

seating the information, the check characters corresponding DECl, which is the first intermediate information xl, is 

to the channel coding Y p and the information Zp generated supplied to the interleaver I that scrambles the bits within the 

in the last iteration step. The decoder module has five ^ character sequences according to an interleaver matrix. This 

outputs, whereby the characters Xp representing the infor- scrambled character sequence is the second intermediate 

mation are delayed via the shift register SRI and the check information x2 that is decoded in the second decoder DEC2 

characters Y p are delayed via the shift register SR2 and also together with the corresponding part of the check character 

wait at the outputs of the decoder module. The extrinsic sequence Y p . The second decoder DEC2 corresponds with 

information Z^* acquired by the current iteration step of the ^ the second encoder of the coder device that generates the 

iterative decoding forms an output of and decoder module appertaining part of the check character sequence Y p . The 

and is returned to the input via a first register Rl; the output second decoder DEC2 generates the third intermediate infor- 

a supplies the abort decision and the output S^ supplies a mation x3 that, following the first de-interleaver DEI, 

weighted decision about the transmitted information after corresponds to the soft output S^ of the iteration. The first 

the last iteration. 45 decoder DO and the second decoder DEC2 need not 

A first input of a first decoder DECl is connected to the necessarily use the same decoding method. They must 

input of the decoder module that carries the characters X^, merely correspond to the appertaining coders of the encoder 

representing the information. An output of the first register means. 

Rl conducts the extrinsic information Zp acquired during the The fourth intermediate information x4, which is likewise 

last iteration step to the first decoder DECl at a second input ^ generated by the second decoder DEC2, is written into the 

This information Zp is set to a neutral value before the first first register Rl as the extrinsic information Z pi . i of the 

iteration, being set thereto via a reset input Reset of the first current iteration step following a de-interleaving in the 

register Rl. A third input of the first decoder DECl is second de-interleaver DE2, so that it is available as extrinsic 

connected to the first contact of a two-stage switchover US. information Zp for the next iteration step. The soft output 

The switchover US is also connected to the input of the 55 s^, that is made available at the output of the second 

decoder module that carries the check characters Y p . de-interleaver DEI is written into the second register R2. 

An output of the first decoder DECl conducts a first The second register R2 is constructed and clocked such that 

intermediate information xl that contains both the extrinsic the soft output signals S p and S p+1 of two successive 

information Zp of the decoding as well as the characters Xp iteration steps are applied concurrently at the device INT for 

representing the information to an input of an interleaver L 60 deciding about the abort The abort signal a is generated by 

In the interleaver L the first intermediate information xl is this device INT. 

scrambled to form a second intermediate information x2. This device INT for determining the abort is described in 

An output of the interleaver I is connected to a first input greater detail below with reference to FIG. 2. A subtraction 

of a second decoder DEC2. so that the second intermediate element SUB has its subtracting input connected to the soft 

information x2 is present at the second decoder DEC2. A 65 output S p generated in the preceding iteration step and is 

second input of the second decoder DEC2 is connected to a connected via an adding input to the soft output S^ 

second contact of the switchover US. In the selected generated in the current iteration step. An output of the 
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subtraction element SUB from which the signal S^-Sp is responding to a dimension of the code, being formed after 

output has a connection to a squarer Q that generates the completion of a complete iteration step, 

square of the signal (S^-Sp). The signal (S^g-S,,) 2 is 3. A method as claimed in daim 1, further comprising the 

conducted to a multiplier element MUL. In this multiplier steps of: 

element MUL, the signal is multiplied with a signal that was 5 calculating a relative entropy using said first and second 

generated by an amount formation of the soft output S p+l weighted decisions; 

generated in the preceding iteration step in a means for comparing said relative entropy to a threshold; and 

amount formation B and by calculating an exponential ^ i(ent - w when ^ relatiye 

function xn a means for exponential formation EX. The is sm ^ la ^ said threshold, 

squarer Q and the means for exponential function formation 10 4 A method ^ daim&d - m daim 3 comprising the 

EX can be realized by corresponding calculating routines or $tep of . 

by tables with non-linearly quantized input and output . ' . * . , . . . . 

i * • » * 7. . _ 4.x jit n ~~ aborting the iterative decoding when a number or ltera- 

values. Accordingly, the multiplier element MUL can also be i i * j j * . 4 _ 

. ^ ' r Uons already completed corresponds to a predeter- 

mined number if the iterative decoding is not already 

The multiplication result is summed up in an accumulator 15 a5orte(l by said relative entropy being smaller than said 

AKK connected to the output of the multiplier element threshold. 

MUL. The relative entropy D of the current iteration is thus 5 Amethod ^ claimcd ^ daim 3 , further comprising the 

approximately present at the output of the accumulator st£p of . 

AKK TTie relative entropy D is thus approximated accord- ^ yary ^ ^ on a 

ing to e equ on. transmission quality and on an average decoding delay. 

D^-^AS^Sf (5) A method as claimed in claim 3. wherein said infer- 

mation to be decoded is transmitted within a plurality of 

The summed-up relative entropy D is compared to a frames and further comprising the step of: 

variable threshold S in a threshold switch SI following the separately detennining said threshold for each of said 

accumulator AKK. The accumulator AKK is reset after frames. 

every iteration step, so that the relative entropy D of the last 7 A mcthod as claimed in claim 3, wherein said relative 

iteration step is compared to the threshold S in the decision entrop y is an approximation of the relative entropy, 

about the abort of the iterative decoding. When the relative % A mgAhod as claimed ^ claim 3, wherein said relative 

entropy D is smaller than the threshold S, an abort signal a M entropy is a quan tity whose properties are similar to the 

is generated at an output of the threshold switch SI. This relative entropy, which quantity is used instead of the 

abort signal a is interpreted by the decoder module, and, relative entropy. 

following the abort of the decoding, the soft output after 9 A memo d as claimed in claim 3, wherein said relative 

the last iterations made available to following modules, as is cntr opy is a quantity which is acquired by forming a 

^ DOWIL 35 difference of at least parts of said weighted decisions, which 

Advantageously, a check to see whether the threshold S is quantity is uscd instead of the relative entropy, 

exceeded can be carried out after each accumulation step. 10 A method as claimed in claim 3, further comprising 

When this is the case, the calculation of the relative entropy ^ ^ of . 

D can be aborted. Othe, r calculating metto^ of tte abort .^^^ ^ relative entropy ^ ^ wiln non . 

signal a en^oyingquant.tos similar to the relate entropy ^ J t JZm vaIues . 

can also be utdized for the «aluat,on of the device INT n. Ame 4^ as clailDS F* claim 1. father comprising the 

regarding the determination of the abort of the iterative ^ ^ . -r © 

decoding. . 

Although other modifications and changes may be sug- additional abort criteria in a decision about 

gested by those skilled in the art it is the intention of the ^ aborting of the iterative decoding, 

inventors to embody within the patent warranted hereon all 43 » A for detamination of an adaptive 

chaiigesandnK)dificationsasreasoiiablyan^ abort cntenon " *? ltcrativc ^coding of multi- 

w2 the scope of their contribution to the art. dimensionally coded infonnaUon, comprising: 

We claim: means for detennining and storing weighted decisions 

1. A method for deternuning an adaptive abort criterion in after an iteration sub-step, 

the iterative decoding of multi-dimensionally coded means for comparing said weighted decisions, and 

information, comprising the steps of: means for initiating an abort of the iterative decoding 

perfo rmin g an iteration sub-step of iterative decoding on dependent on a comparison result by said means for 

information to be decoded, said iteration sub-step pro- comparing. 

ducing a soft output; 55 13. A decoder module as claimed in claim 12. wherein 

following said iteration sub-step, comparing a first said means for determining and storing the weighted deci- 

weighted decision about the information to be decoded sions delude: 

to a second weighted decision that is acquired from a means for acquiring a first weighted decision from a 

combination of sub-results of preceding iteration sub- current iteration step; 

steps differing from the first weighted decision, said 60 means for acquiring a second weighted decision from a 

first weighted decision being based on said soft output, combination of sub-results of preceding iteration sub- 

and steps differing from said first weighted decision; 

aborting the iterative decoding dependent on the compari- and wherein said means for comparing the weighted deci- 

son result sions include 

2. A method as claimed in claim 1, wherein said first and 65 means for detennining relative entropy from the weighted 
second weighted decisions on which said comparing step is decisions, said relative entropy being compared to a 
based are formed from components of the code, each cor- threshold, and the iterative decoding being aborted by 
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the means for initiating an abort of the iterative decod- 
ing when the relative entropy is smaller than the 
threshold. 

14. A decoder module as claimed in claim 13, further 
comprising: 

means for setting said threshold so that said threshold can 
be separately set for each frame for information trans- 
mitted in frames. 
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15. A decoder module as claimed in claim 13. wherein 
said means for initiating the abort of the iterative decoding 
dependent on the comparison result likewise effect the abort 
of the iterative decoding after a maximum plurality of 
iterations determined by setting means. 
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